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Abstract — We consider the distributed source coding system for 
L correlated Gaussian remote sources Xi, i = 1, 2, • • • , L, where 
Xi,i = l, 2, ■ ■ ■ ,L are L correlated Gaussian random variables. 
We deal with the case where each of L distributed encoders can 
not directly observe Xi but its noisy version Yi — Xi + Ni. Here 
Ni,i — 1,2, ■ ■ ■ , L are independent additive L Gaussian noises 
also independent of X iy i = 1,2, •• ■ ,L. On this coding system 
the determination problem of the rate distortion region remains 
open. In this paper, we derive explicit outer and inner bounds of 
the rate distortion region. We further find an explicit sufficient 
condition for those two bounds to match. We also study the sum 
rate part of the rate distortion region when the correlation has 
some symmetrical property and derive a new lower bound of the 
sum rate part. We derive a sufficient condition for this lower 
bound to be tight. The derived sufficient condition depends only 
on the correlation property of the sources and their observations. 

Index Terms — Multiterminal source coding, Gaussian, rate- 
distortion region, CEO problem. 



I. Introduction 

In multi-user source networks distributed coding of corre- 
lated information sources is a form of communication system 
which is significant from both theoretical and practical point 
of view. The first fundamental theory in those coding systems 
was established by Slepian and Wolf [1|. They considered a 
distributed source coding system of two correlated information 
sources. Those two sources are separately encoded and sent to 
a single destination, where the decoder reconstruct the original 
sources. In this system, Slepian and Wolf (T| determined 
the admissible rate region, the set that consists of a pair of 
transmission rates for which two sources can be decoded with 
an arbitrary small error probability. 

In the above distributed source coding system we can con- 
sider the case where the source outputs should be reconstructed 
with average distortions smaller than prescribed levels. Such 
a situation suggests the multiterminal rate-distortion theory. 

The rate distortion theory for the distributed source coding 
system formulated by Slepian and Wolf has been studied by 
j2]-||9l- Recently, Wagner et al. [flOl have given a complete 
solution in the case of Gaussian information sources and mean 
squared distortion. 

As a practical situation of the distributed source coding 
system, we can consider a case where the separate encoders 
can not directly observe the original source outputs but can 
observe their noisy versions. This situation was first studied 
by Yamamoto and Ito 1111 . Subsequently, a similar distributed 
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source coding system was studied by Flynn and R. M. Gray 
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In this paper we consider the distributed source coding 
system for L correlated Gaussian remote sources Xi,i = 
1, 2, • • • , L, where Xi, i = 1, 2, ■ ■ • , L are L correlated Gaus- 
sian random variables. We deal with the case where each of 
L distributed encoders can not directly observe Xi but its 
noisy version Yi = Xi + Ni. Here Ni, i = 1, 2, ■ • • , L are 
independent additive L Gaussian noises also independent of 
Xi, i = 1, 2, • • • , L. In the above setup Yi, i = 1, 2, • • • , L can 
be regarded as correlated Gaussian observations of Xi,i = 
1,2, ■ • ■ ,L, respectively. This coding system can also be 
considered as a vector version of the Gaussian CEO problem 
investigated by [[13], El, and 03), where X { , i = 1, 2, • • • , L 
are identical. 

The above distributed source coding system was first posed 
and investigated by Pandya et al. Ifl6l . They derived upper and 
lower bounds of the sum rate part of the rate distortion region. 
Oohama IfTTl , |[T8l derived explicit outer and inner bounds of 
the rate distortion region. Wagner et al. ifTOl determined the 
rate distortion region in the case of L = 2. 

In 0181 . Oohama also derived a sufficient condition for his 
outer bound to coincide with the inner bound. Subsequently, 
Oohama Ifl9l derived a matching condition which is simple 
and stronger than that of Oohama |fl8l . 

In this paper, we derive a new sufficient condition with 
respect to the source correlation and the distortion under 
which the inner and outer bounds match. We show that if the 
distortion is smaller than a threshold value which is a function 
of the source correlation, the inner and outer bounds match 
and find an explicit form of this threshold value. This sufficient 
condition is a significant improvement of the condition derived 
by Oohama |[T9l . We also investigate the sum rate part of rate 
distortion region. The optimal sum rate part of the outer bound 
derived by Oohama Ifl8l serves as a lower bound of the sum 
rate part of the rate distortion region. When the covariance 
matrix S x l of the remote source X L = (X\, X2, ■ ■ ■ , Xl) 
have a certain symmetrical property and the noise variances of 
Ni,i — 1,2, L have an identical variance denoted by a 2 , 
we derive a new lower bound of the sum rate part. We further 
derive a sufficient condition for this lower bound to be tight. 
The derived sufficient condition depends only on E X i and a 2 . 
From this matching condition we can see that an explicit form 
of the sum rate part of the rate distortion region can be found 
when the noise variance a 2 is relatively high compared with 
the eigen values of £ x l . 

In Oohama IfTTl . |fl8l . details of derivations of the inner and 
outer bound were omitted. In this paper we also present the 
details of derivation of those two bounds. 
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The rest of this paper is organized as follows. In Section 
II, we present problem formulations and state the previous 
works on those problems. In Section EH, we give our main 
result. We first derive explicit inner and outer bounds of the 
rate distortion region. Next we presented an explicit sufficient 
condition for the outer bound to coincide with the inner bound. 
In Section IV, we explicitly compute the matching condition 
for two examples of Gaussian sources. In Sections V and VI 
we give the proofs of the results. Finally, in Section VII, we 
conclude the paper. 

II. Problem Statement and Previous Results 
A. Formal Statement of Problem 

In this subsection we present a formal statement of problem. 
Throughout this paper all logarithms are taken to the base 
natural. Let A = {1, 2, • • • , L} and let Xi, i € A be correlated 
zero mean Gaussian random variables taking values in the 
real lines XJ 1 . We write a L dimensional random vector as 
X L = (Xi,X 2 , •••,Xl) and use similar notation of other 
random variables. We denote the covariance matrix of X L 
by Ejl. Let {(Xi.t, X 2<t , • • • , XL,t)}tL\ be a stationary 
memoryless multiple Gaussian source. For each t = 1,2, • • • , 
(Xi t t, X2,t, ■ ■ ■ , A"L,t) obeys the same distribution as (X±, 
X2, ■ ■ ;Xl) ■ Let a random vector consisting of n independent 
copies of the random variable Xi be denoted by Xj = Xn 
Xi.2 ■ ■ ■ X i n . Furthermore, let X L denote the random vector 
(Xi,X 2 , • • • , X L ). 

We consider the separate coding system for L correlated 
sources, where L encoders can only access noisy version Jj 
of Xj for i = 1, 2, ■ ■ ■ , L, that is, 



Yi = Xi + Ni,ie A 



(1) 



where iVj, i £ A are zero mean independent Gaussian random 
variables with variance a^.. We assume that X L and N L 
are independent. The separate coding system for L correlated 
Gaussian remote sources is shown in Fig. 1. For each i G A, 
the noisy version Y i of Xi is separately encoded to cpi(Yi). 
The L encoded data ipi(Yi), i e A are sent to the information 
processing center, where the decoder observes them and out- 
puts the estimation (Xi, X 2 , ■ ■ ■ , Xl) of (Xi, X 2 , ■ ■ ■ , Xl) 
by using the decoder function t/j = (tpi, tp 2 , • • • , 4>l)- 
The encoder functions (fi , i e A are defined by 



<p i :X?^M i = {l,2,---,M i } 



and satisfy rate constraints 
1 



log Mi < Ri 



(2) 



(3) 



where S is an arbitrary prescribed positive number. The 
decoder function ip = (tpi, ip 2 , • • • j ^l) is defined by 



tpi : Mi x • • • x Mi 



X™ , i — 1, 2, • • • , L, 



(4) 



where Xi is the real line in which a reconstructed random 
variable of Xj takes values. Denote by (Ri , R 2 , ■ • • , Rl) 
the set that consists of all the (L + 1) tuple of encoder and 




^ -*{X U X 2 , 



,X L ) 



Fig. 1. Separate coding system for L correlated Gaussian 
observations 



decoder functions (cpi, tp 2 , • • •, <Pl, ip) satisfying (f2])-(|4|i. For 
X L = (X\, X 2 , • • • , Xl) and its estimation 

x L = (X 1 ,X 2 ,---,X L ) 



set 



d u = mx t -x 

A 



d 



E(X, - X h Xj - Xj) ,1 < i < L. 



where | a \ \ stands for the Euclid norm of n dimensional vector 
a and (a, b) stands for the inner product between a and b. Let 
H xL _£L be a covariance matrix with dij in its (i,j) element. 

In this communication system we can consider two dis- 
tortion criterions. For each distortion criterion we define the 
determination problem of the rate distortion region. Those two 
problems are shown below. 

Problem 1. Vector Distortion Criterion: Fix positive vector 
D L = (Di, D 2 , ■ ■ ■ , Dl). For a given D L , the rate vector 
(Ri, R 2 , ■ ■ ■ , Rl) is admissible if for any positive 5 > and 
any n with n > no(S), there exists (ipi, cp 2 , ■ ■ ■ , ifL, ip) £ 
■ ,Rl) such that 



J 7 / 1 (Ri, R2 



is 



x L -x^ 



<D Z + S, 



where [A]u stands for the (i,j) entry of the matrix A. Let 
1Zl(D l ) denote the set of all the admissible rate vector. On 
a form of 1Zl(D l ), we have a particular interest in its sum 
rate part. To examine this quantity, define 

L 



Rs 



XD 1 



mm 

■,R L )£n L (Di 



To determine R S um,L(D L ) in an explicit form is also of our 
interest. 

Problem 2. Sum Distortion Criterion: Fix positive D. 
For a given positive D, the rate vector (R\, R 2 , ■ ■ ■ , Rl) is 
admissible if for any positive S > and any n with n > uq(S), 
there exists ((pi,<p 2 , ■ ■■ , ifL, ip) GJ 7 g(Ri,R 2 ■ ■ ■ , Rl) such 
that 



tr 



<D + S, 
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Let 1Zl(D) denote the set of all the admissible rate vector. To 
examine the sum rate part of TZl(D), define 



Rsum,L(D)= min < V" Ri 



We can easily show that we have the following relation 

(5) 



between K L (D) and H^ n) (D L ): 



U L (D)= |J K L (D L ) 



In this paper our argument is concentrated on the study of 
Problem 2. It is well known that when D > tr[S x t], Ri = 
i?2 =• • • = Rl = is admissible. In this case, we have 

K L (D) = {(R 1: ■ ■ ■ , R L ) : R, > 0, i £ A} . 

In the subsequent arguments we focus on our arguments in 
the case of D < tr[£, X L ]- 



B. Previous Results 

In this subsection we state previous results on the deter- 
mination problem of 1Zl{D). We first state a previous result 
on an inner bound of TZl(D) and 1Zl(D l ). Let Ui, i £ A be 
random variables taking values in real lines Ui. For any subset 
S C A, we introduce the notation Us={Ui)i^s- In particular, 
U\= U l =(Ui, U2, ■ ■ ■ , Ul). Similar notations are used for 
other random variables. Define 



G(D L ) = {U 



U L is a Gaussian 

random vector that satisfies 

U s -> Y s -> X L -> Y S c - U S o , 

u L -> y l -> x L 

for any SC A and 

e[x 4 -^(^ l )] 2 < A 

for some linear mapping 

V»i : u L -> £ A. } 



and set 



n) (# L ) = 



(in) 



(D) = conv 



There exists U L £ 5( J D L 
such that 

^Ri > I(U s ;Y s \U S c) 

for any S C A . } , 

There exist -D L and 
U L £ ^(-D L ) such that 

^Ri > I(U s ;Y s \U S c) 
ies 

for any S C A and 
A < £> . } , 



where conv{A} denotes a convex hull of the set A. We 
can easily show that we have the following relation between 

n { t\D) and nl n) (D L ): 



u 



n ( l n) (D L ) 



(6) 



Then, we have the following result. 
Theorem 1 (Berger ^ and Tung ^5]/J." 



7t£ n; (£>) C K L {D),lll n) (D L ) C TZ L {D L ). 

The inner bound 1z^\d l ) is well known as the inner 
bound of Berger 0] and Tung (5J. The inner bound 7^ n) (D) 
can be regarded as a variant of their inner bound. 

The source coding problem considered in this paper was 
first posed and investigated by Pandya et a/. lfl6l . They dealt 
with the case that Y L = X L A + N L , where A is L x L 
a positive definite attenuation matrix. When A is an identity 
matrix, the problem studied by Pandya et al. is the same as 
the problem considered here. They derived upper and lower 
bounds of R sum ^(D). 

Recently, Wagner et al. iflOl have determined 7?-2(A, A)- 
Their result is as follows. 

Theorem 2 (Wagner et al. IHW ): For any positive A and 
A, we have 

7e2(A,A) = ^i in) (A,A). 

From the above theorem, (O and (O, we immediatly obtain 
the following corollary. 

Corollary 1 (Wagner et al. IHW ): For any positive D, we 
have 

K 2 (D) ='R$ a \D). 

According to Wagner et al. iflOll . the results of Oohama |9l , 
lfT4l . and lfT31l play an essential role in deriving the above 
result. The determination problems of 1Zl(D l ) and TZl(D) 
for L > 3 still remains to be solved. Their method for the 
proof depends heavily on the specific property of L = 2. It is 
hard to generalize it to the case of L > 3. 



(in), 



t=l 



III. Main Results 

In this section we state our results on TZl(D) and R sum l{ 
D). 



A. Definition of Functions and their Properties 

In this subsection we define several functions which are nec- 
essary to describe our results and present their properties. For 
i'i > 0, i £ A, let Ni(ri), i £ A be L independent Gaussian 
random variables with mean and variance cr^./(l — e~ 2ri ). 
Let Sjvi( r i.) be a covariance matrix for the random vector 

N L (r L ). For any subset S C A, we set r§ = (r,), e g. In 



particular, ta 



(ti, T"2, ■ • • , Tl)- Fix nonnegative vector 
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r L . Let a, = ai(r L ),i £ Abe L eigen values of the matrix 
S"i +E" 1 L(ri) . For S C A, and > 0, define 



y -l A i 



J s (0,rs\rs°) = ^ log" 1 



■M?",s|r>) = ^log 



r s =0 



2/', 



yi-1 . y — 1 





AGS ) 




yi — 1 | yi— 1 





where 5 C = A — S and log x = maxjloga;, 0} . Let Bl(D) 
be the set of all nonnegative vectors r L that satisfy 

-l" 



tr 



- l N L (r L ) 



< D . 



(7) 



Let dB L (D) be the boundary of B L (D), that is, the set of all 
nonnegative vectors r L that satisfy 

(s"i + e; " 



tr 



J N{r L ) 



D. 



Let £ be nonnegative number that satisfy 



i=i 



Define 



^(Ar i ) = n{[e-^ 1 ] + + «r 1 } 



We can show that for S C A, J_ s (d{D,r L ),rs\r s ^) and 
Js (rs | rsc ) satisfy the following two properties. 
Property 1: 

a) If r L e Bi(D), then, for any 5 C A, 

J s (0(^,r L ),r s |r S c) < J s (r s |r S o). 

The equality holds when r L € DBl{D). 

b) Suppose that r L e B L (D). If r L | r still belongs to 
Bl{D), then, 

J s (0p,r L ),r s |r Sc )| rs=o = ^(r S |r S c)| rs=0 
= 0. 

Property 2: Fix r L e B L {D). For 5 C A, set 

/5 = /s(T-slrsc) = J s (0p,r L ),r s |r S c) . 

By definition it is obvious that fs,S C A are nonnegative. 
We can show that / = {/s}sca satisfies the followings: 

a) h = 0. 

b) /a < f B for A C S C A. 

c) Ia + Ib< Iahb + Iaub ■ 

In general (A, /) is called a co-polymatroid if the nonnegative 
function / on 2 A satisfies the above three properties. Similarly, 
we set 



fs = fs(rs\rs°) = Js(rs\rs°), / = {/s} 



Then, (A, /) also has the same three properties as those of 
(A, /) and becomes a co-polymatroid. 

B. Results 

In this subsection we present our results on 1Zl(D). To 
describe our result on inner and outer bounds of TZl(D), set 

^'(5/)= {i? L : J s (0(Ar i ),r s |r S c) 

for any SCA.}, 
K (out) (D) A y ^(°ut)p r L ); 

r L eei(D) 

fcfV)* {R L : £i? 4 > J S (r s |r S c) 
for any SCA.}, 

K<t\D)± conv i |J ftfV) 

Our main result is as follows. 

Theorem 3: 

1Z { i a) (D) C TZ^ n \D) C 7e L (D) C K { ° ut) (D) . 

Proof of this theorem will be given in Section V. 

An essential gap between 1Z^ ut \D) and 7i^ n \D) is the 
difference between J_ S (8(D, r L ),rs\rs<=) in the definition of 
K { L Ut) (D) and J s (r s | r S c) in the definition of ^ in) (L»). 
By Property [1] part a) and the definitions of TZ^ nt \D,r L ) 
and ^ n) ( r L ), if r L e dB L (D), then, 



ft 



(out) 



(.D, r L ) = IZ^ (r L ) , 



which suggests a possibility that in some nontrivial cases 
TZ^ ut) {D) and TZ^ a) (D) match. For L > 3, we present a 
sufficient condition for 7?.^° ut ' (D) C ft^ (-D) . We consider 
the following condition on 9(D,r L ). 

Condition: For any £ £ A, c~ 2ri 0(D, r L ) is a monotone 
decreasing function of r; > 0. 

We call this condition the MD condition. The following is 
a key lemma to derive the matching condition. 

Lemma 1: If 6(D,r L ) satisfies the MD condition on Bl( 
D), then, 

TlP(D) = HP(D) = K L (D) = n { ° ut) {D). 

Proof of this lemma will be given in Section VI. Based on 
Lemma [T] we derive a sufficient condition for 8(D,r L ) to 
satisfy the MD condition. 



Let an, i 
A i 



1,2,- 



, L be (i, i)-element of E xi and set 



^min(^ 

) and a D 



a max (r L ) be 



the minimum and maximum eigen values of E~i+ E~ 
respectively. The following is a key lemma to derive a suffi- 
cient condition for the MD condition to hold. 

Lemma 2: If a m [ n (r L ) and a max (r L ) satisfy 

1 1 1 



SCA 



c(r L ) 



< 



for i G A 



5 



on Bl(D), then, 8(D,r L ) satisfies the MD condition on 
B L (D). 
Set 

C = Ejvl) : r L e B L (D) 



for some nonnegative r .}. 



When r L > ,s L , we have 



J N L (r L ) 
y-1 



>- s 



J N L (s L ) ' 



"^(s-i+S-i^)" 1 , (8) 
where B y A stands for that B — A is positive semi-definite 

r / - \ -i" 

The equation ((SJ implies that tr 



Tr 1 



J N L (r L ) 



monotone decreasing function of r L . Hence, we have 



is a 



C = 



{(A: 



J A- 



,,E 



A 1 



D > tr 



} 



From Lemmas [Tj [2] and an elementary computation we obtain 
the following. 

Theorem 4: Let a* nax be the maximum eigen value of 



tr 



-l 

A L 



A 1 



< D < 



then, 



In particular, 



£+1 

a* 



n { ° nt) {D). 



Rsum,L(D) 



mm 



i=l 



log 



J N L (r L ) 



IE" 1 I 



(9) 



Proofs of Lemma|2]and Theorem|4]will be stated in Section 
VI. From Theorem!?) we can see that we have several nontriv- 
ial cases where 7c^\D) and 7c£ ut \D) match. In Oohama 
|fl9l , the author derived the sufficient matching condition 
— on upper bound of D. Thus the matching 



D < 



condition presented here provides a significant improvement 
of that of Oohama |[T9l for large L. 

We further examine an explicit characterization of R sum .L( 
D) when the source has a certain symmetrical property. Let 

1 2 ••• i ■■■ L 
r(l) t(2) ■ ■ ■ r(t) ■ ■ ■ t(L) 

be a cyclic shift on A, that is, 

r(l) = 2, r(2) = 3, • • • , t(L - 1) = L, r(L) = 1 . 

Let px A (x A ) = px 1 x 2 -x L (xi,x 2 , - ■ ■ be a probability 
density function of X L . The source X L is said to be cyclic 
shift invariant if we have 

PX A ( x r(A) ) =PXiX 2 -Xl( x 2,X3,---,X L ,X 1 ) 

= Px 1 x 2 ---x L (xi,x 2 , ■ • ■ ,X L -l,X L ) 

for any (x\,X2, ■ ■ • , x£)& X L ' ■ In the following argument we 
assume that X L satisfies the cyclic shift invariant property. 
We further assume that Ni,i G A are independent identically 



distributed (i.i.d.) Gaussian random variables with mean and 
variance a 2 . Then, the observation Y L = X L + N L also 
satisfies the cyclic shift invariant property. 

Fix r > 0, let Ni(r), i G A be L i.i.d. Gaussian random 



variables with mean and variance a /(l - 



-2r\ 



Let E 



N L {r 



be a covariance matrix for the random vector N L (r). Let 
Xi,i € A be L eigen values of the matrix Hx L aR d let 



Pi 



Pi(r),i G A be L eigen values of the matrix E 



A L 



be written as 



Using the eigen values of [3i(r),i £ A can 



Pi(r) = 



A, 



■(l-c" 2r ). 



Let £ be a nonnegative number that satisfies X}^=i{[£ — /?, X ] + 
+/3" 1 } = L>. Define 

L 

oiD^^niiz-PiY+Pi 1 }, 



J(6(D,r),r) = hog 



e \h X L 



and set 



(r) = tr 



J N L (r 



L 



Since </>(r) is a monotone decreasing function of r, there exists 
a unique r such that <f>(r) = D, we denote it by r*(D). Note 
that 



(r, r, ■ ■ ■ ,r) G B L {D) 

L 



<D^r>r*(D), 



B(D,r*) 



J x L 



Set 



R 



(i) 

sum.L 



(A 



A 



min J(0(D,r),r). 



Then, we have the following. 

Theorem 5: Assume that the source X L and its noisy 
version Y L = X L + N L are cyclic shift invariant. Then, we 
have 

RsumAD) > RHL,l(D) ■ 



Proof of this theorem will be stated in Section V. 



Next, we examine a sufficient condition for R 



(i) 



■AD) to 



coincide with -R S um.z,(A- ^ i s obvious from the definition 
of J_(6{D,r),r) that when c~ 2Lr 9(D,r) is a monotone de- 
creasing function of r G [r*(D), +oo), we have -Rsu m .t(A 

= Rsum,L\D). 

Lemma 3: Let a be an identical diagonal element of E^-i . 

Set c = 4y . Let A m ; n and A max be the minimum and 
maximum eigen values of ^x L < respectively. Let the minimum 
and maximum eigen values of T, x \+ E^, , be denoted by 
/3min = Pmin(r) and /3 max = /3 max (r), respectively. Those are 
given by 

1 1 



Pu, 

Pu 



Ar) - 
x(r) 



A 



max 

l 



i 



ra- 
ti 



-2r 



-2c 



), 
)• 
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If AninM and /3 max (r) satisfy 



1 



< 



La 2 e 2r /3 min (r) 

&nin(r) Anax(r) ~ If — 1 /3 

max V } 

for r > r*(D), then, c~ 2Lr 9(D,r) is a monotone decreasing 
function of r e [r*(D),oo). 

From Lemma [3] and an elementary computation we obtain 
the following. 

Theorem 6: Assume that X L and Y L = X L + N L are 
cyclic shift invariant. If 



2 ^ ^max , . 
°~ C. j ' T lA max 



^min) 



(10) 



then, -Rs mni (£>) = Rsum,L(D). Furthermore, the curve R 
Rsum,L(D) has the following parametric form: 



R 



D = 



log 



L 

E 



Proofs of Lemma [3] and Theorem [6] will be stated in 
Section VI. Note that the condition dTOb depends only on the 
correlation property of X L and N L . From Theorem[6]we can 
see that for (X N ,N N ) satisfying the cyclic shift invariant 
property the determination problem of R S um,h(D) is solved 
if the identical varaince a 2 of Ni,i G A is relatively high 
compared with the eigen values of E^l . 

IV. Computation of Matching Conditions 

In this section we explicitly compute the matching condition 
for some class of Gaussian information sources. Define 



A 



m = an + Cj(l - c 2r <) ,i e A. 
From ( fTTT i. we have 

2ri = log ■ 



(11) 



an +Ci — iM 



By the above transformation we reg ard 6(D,r L ) and £"i 



J N L (r L ) 



as functions of u L , that is, 9(D, r L ) = 9(D, u L ) and 



E w. + S7 1 



We consider the case where E x l have identical diagonal and 
nondiagonal elements, that is, 

Var[Xi] = a 2 x . = 1 , for i e= A, 
Cov[X t , X,-] = pox.oxj = P for i, j e A, i ^ 

In this identical variance case, elements a 2 j of is 

given by 



l + (L-2)p 



if i = 3 , 



(l-p)(X+(L-l)p) ° / J 1 



For simplicity of notations we set a = au,b = —atj. We first 
derive an explicit form of the set Bl{D). To this end we use 
the following formula 



z\ S . . . 5 
S Z2 ... S 



.(12) 



k i=l 



5 5 . . . 

Using ( [12] ). the condition 



tr 



v-i-l i y-1 



(13) 



is explicitly given by the following: 

b 2 



E 



{Ui+b){ U] +b) 



i=l 



uu + b 



Db>0. 



(14) 



Set 



a 1 1 + Db a L 

«1 = 77 ' — -,«2 = 777 77(1 + -D&) - 06. 



2 L-l 4(1-1) 
Then, the above condition is rewritten as 



E( k i-^)(^-^)^- ^ 



From ( fl3] l. we can see that the region C is given by the set of 
all (a,b,c L ,D) satisfying 



(16) 



The above condition is equivalent to 

b 2 



E 



(a + b + Ci)(a + b + Cj) 



-(l + Db)J2 



a + b + Ci 



Db>0. 



(17) 



Solving (HI with respect to D, we obtain 



D > 



E a+b+a E (a+b+ Ci )(a+6+ Cj ) 
*=1 i^j 



i-E; 



(18) 



4=1 



From Theorem [4] we obtain the following corollary. 
Corollary 2: If D satisfy 

L 



/_ ^ a+b+Ci /_ ^ (a 



+ b+ Ci )(a+b+ Cj ) 

^ r> ^ L+l 



< D < 



then 



i=l 

TlPiD) = K L (D) = TZ { ° ut) (D). 
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Next we derive a more explicit sufficient condition. Set 

A . A 

Cmin — mm Cj, c max — max Ci . 

Ki<L Ki<L 



Then, the condition 



L(L-l) ( Kl -- 



> K 2 



(19) 



J+6+C m i„ , 

is a sufficient condition for (a,b,c L , D) 6 C. The above 
condition is equivalent to 



D > 



i 



a+6+c m i n — Lb 



(20) 



On the other hand, the maximum eigen value of 



+^ n 1 l (u l^ satisfies 



«L < max {Uj + b} <a + b+ c„ 



(21) 



Properties on bounds of the eigen values of E~^ + E"^, L ^ 
including the property stated in ( f2TT > and their proofs are given 
in Appendix C. From d20l l, (EH . and Corollary [2] we obtain 
the following theorem. 

Theorem 7: If (a, 6, c m i n , c max , 13) satisfies 



• 1 



O+fa+Cmin V £l + b+C m i n — £6 



< L> < 



(22) 



then, 



^ in) (Z3) = TZl(D) = K ( ° ut) (D). 



In particular, 



Rsum, l(D) 



mm 



i=l 



log 



y-1 , yi— 1 



(23) 



It can be seen from d22l that the matching condition 
holds for sufficiently small b and c max . This implies that the 
determination problem of TZl(D) is solved if the correlation 
of X L is relatively small and the noise variance of N L is 
relatively large. 

Now we derive an explicit form of R SU m,L(D) in the case 



where c 



In this case, we have 



C = {(a,b,c,D) 
D > 



L 

a+b+c 



b \x 

a+b+c-Lb J J 



Set 



Li = — 
2 



l + Db+J(l-Db) 



ADb 
L 



(24) 



Solving the minimization problem in the right member of ( l23l . 
we have the following. 

Theorem 8: If (a, b, c, D) satisfies 



a+b+c 



1 



\-b+c-Lb 



< D < 



fl + r) (25) 



then, 

Rsum,L{D) 



log 



/ (1 - p)X lC 
D(a + & + c) - Li 



Proof of this theorem is given in Appendix A. 
Next, we consider another example where the source and 
its noisy observation are cyclic shift invariant. Let L = 4 and 



E Y4 



lpOp 
plpO 
Oplp 
pOpl 



\p\ < Tj, s /y4 



10 
10 
10 
1 



(26) 



In this case, we have 



l-2p 2 



|E^| = l-V,o = x 
Ai = 1 - 2p, A 2 = A 3 = 1,A 4 = 1 



2p. 



Four eigen valules /3, (r) , i 

Mr) 

/3 4 (r) - l + 2p + 
The matching condition is 

a 2 > 3|p| 



1, 2, 3, 4 are given by 

2r\ 



l-2p+ X (l-e- 21 -) 



1 



7^(1 



[1-e 



-2r\ 



(27) 



l + 2|p| 
l-2|p| 



Summerizing the above argument, we obtain the following. 
Theorem 9: We consider the case where L = 4, E^ 4 an d 
are given by d26| i. If 

2\p\ 



c > 3|p| 



1-2H' 



then, the rate distortion curve R = i? sum ,4(-0) has the 
following parametric form: 



R 



D 



1 



log 



(l-4p 2 )e 8r n^« 



4 



where (3i(r), i = 1, 2, 3, 4 are definded by (ITTI i. 

From this theorem we can see that for the above example 
of (X 4 , TV 4 ) satisfying the cyclic shift invariant property the 
determination problem of R S um,4(D) is solved if the identical 
varaince a 1 is relatively high or correlation coefficient p is 
relatively small. 

The determination problem of R sunl! L(D) was first investi- 
gated by Pandya et al. ifTBI . They derived upper and lower 
bound of R S um,L{D)- Pandya et al. Ifl6l also numerically 
compared those two bounds to show that the gap between them 
is relatively small for some examples. In this paper we have 
determined R SU m.L(D) for some nontrivial case of Gaussian 
sources. 

V. Derivation of Outer and Inner Bounds 

In this section we state the proofs of Theorems [3] and [5] 
stated in Section III. 
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A. Derivation of the Outer Bound 

In this subsection we prove the inclusion 1Zl(D) C 
7?4 out) (D) stated in Theorem EJ We use the following two 
well known lemmas to prove this inclusion. 

Lemma 4 (Water Filling Lemma): Let a^i = 1, 2, • ■ • , L 
be L positive numbers. The maximum of YliLr & subject to 
Y,i=i &< D and & > a h i = 1, 2, • • • , L is given by 

L 

{J {[£-<!;]++ a;} , 
i=l 

where £ is determined by X^=i {[£ ~ a i] + + a ?} = -D- 

Lemma 5: For any n dimensional random vector Ui,i = 
1,2, we have 



-/i([/l|t/ 2 ) < ilog 
n 2 



(27re) • -E||C/i - C/ 2 | 

n 



(28) 



where /i(-) stands for the differential entropy. 

Next, we state an important lemma which is a mathematical 
core of the converse coding theorem. For i = 1, 2, • • • , L, set 



Wi = ipi(Xi),r. 



(n) 



A 1 



i(yi;Wi|jrO 



(29) 



For 5 C A, let Qs be a unitary matrix which transforms Xs 
into Z s = X s Qs- For X s = (X s ,i, X s ,2, • • -,-X's,ti), we 
set 

= -X^sQs = {Xs,lQs: X S ^Qs, ■ ■ ■ , Xs, n Qs) ■ 

Then, we have the following lemma. 
Lemma 6: For any 5 C A, we have 

h{Zi\Z S -wWs) 



> - log <^ (2ttc) 



^ ( ^ 







)Qs 






ii \ 



where [C]y stands for the element of the matrix C. 

Proof of this lemma will be stated in Appendix B. This 
lemma provides a strong result on outer bound of the rate 
distortion region. From Lemma [6] we obtain the following 
corollary. 

Corollary 3: For any S C A, we have 



I(Xs;W s ) < - log 



7 + 



(30) 



Proof: We choose unitary matrix Qs so that 



Q 



S 1 ( E ^s 



N s (r' s 



becomes the following diagonal matrix: 



rs 1 ( 



N s (r 



Qs 





V2 







(31) 



Then, we have the following chain of inequalities: 

I(X s ;Ws) 

( => h(X s )-h(Z s \Ws) 

\s\ 

< h(X s ) -^2h(Zi\Z 8 -{i } Ws) 

i=l 

j) |log [(2^0)1^1 \E Xs 



< 



i—l v 



Qs 1 ( ^X s 



(c) ra 



-log|S Xs | + 2^^1og [i/i] 



= — log I + — log 



S *s + S AT s ( r <,">) 



= 5 lo s 



3 Ns(r^) 



(32) 



Step (a) follows from the rotation invariance of the (condi- 
tional) differential entropy. Step (b) follows from Lemma [6] 
Step (c) follows from (E). ■ 

Using Lemmas |4]|6] Corollary [3] and a standard argument 
on the proof of converse coding theorems, we can prove 
TZl(D) CK { ° ut) (D). 

Proof of K L (D) C TZ^ ut) (D): Assume that (Ri,R 2 , 
■•-,Rl) € TZl(D). Then, for any <5 > and any n with 
n > n (5), there exists (ipi, tp 2 , ■ ■ ■ , cpl, €Js (Ri,Ra 



■ , -Rl) such that 



^EIIX.-X.II 2 <D + S. 

i=l 

We set Za = XaQ, Za = X\Q. Furthermore, for i 6 A, 
set 

^-EIIZ.-Z.H 2 . 

n 

By rotation invariance of the squared norm, we have 

i=i 
L i 

= V-E||X,-X !; || 2 < 

Z ^ 77 



! = 1 



D + <5. 



(33) 



By Lemmas [5] and |6j for i = 1, 2, • • • , L, we have 



2 log 



(2 7 re)C l ( " ) > - Zi) > /i(Zi|Z;) 



>/i(Z 1 |IVa)>/ 1 (Z 1 |Z a _ {4} 1Va) 



> -log^vre) 



from which we have 



1-1 S. 1 + ST 1 . , ) Q 



for i £ A . 



(34) 
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Now we proceed to the derivation of the outer bound. We first 
observe that 



= 2 l0g 



W s -> X s -» X S c -> W S c 



(35) 



n 



S Xa + S W A (r'" c ») 



L e (n) 



nr=ie 



hold for any subset S of A. For any subset S C A, we obtain 
the following chain of inequalities: 



Note here that 



ies ies 
> ^H(Wi)>H(W s \W s °) 



I(X A ;W s \W S o)+n^2 



» 



ies 



ies 



is nonnegative. Hence, we have 

I{X K -Ws\W s ^+7iY, r{ ^ 



= I(X A ;W s \W S c) + H(W S \W SC X A ) 
= I(X A ;W s \W S c)+J2 H ( W *\ X ^ 



> nisi ]Ji 



00 „» 



ieS 



» 



(39) 



/(X A ;Ws|W S c)+^i?(Wi|Xi) 



ies 



(a) 



/(X A ;W s |W S c)+n^r. 



(n) 



(36) 



(40) 



Step (a) follows from (l35l l. We estimate a lower bound of 
7(Xa;Ws|W S c). Observe that 

I(X A ; W s \Ws*) = I(X A ; W A ) - I(X A ; W S c) 

= I(X A ;W A )-I(X S c;W S c). (37) 

Since an upper bound of I(Xgc ; VFsc ) is derived by Corollary 
[3] it suffices to estimate a lower bound of I(X A ; W A ). On a 
lower bound of this quantity we have the following chain of 
inequalities: 

I{X A -W A ) 

= h(X A ) - h(X A \W A ) ® h(X A ) - h(Z A \W A ) 



Combining (f36t and d39l , we obtain 

ies \i=l 
for S C A. For i G A, set 

i-i = limsuprj n) = limsup -I{Y l ;W i \X i ) , 

n — *oo n — *oo Tl 

& = limsup = limsup -E\\Zi ~ Zi\\ 2 . 

n — >oo n— >cc 

Then, by letting n — > oo in (l33k (l34k and d40K we obtain 



i=l 



6> 



S X A + S N A (r A ) ) <9 



for i G A . 



> (41) 



i=l 
L 

> ^(Xa)-^M^I^) 



i=l 



(b) 



> -log[(2 7 re) i |Sx A |] - E 9 lo S ( 27re )£ 



,(n) 



ies 

for SCA. 

Since S can be made arbitrary small, we obtain 

L 



n n 
-log|E XA - 2 g 



00 



Q 1 ( + ^ W. I 



(38) 



X A ^ N\ (r A ) 

for i G A . 



Step (a) follows from the rotation invariance of the differential 
entropy. Step (b) follows from LemmaO Combining ( T37l >. ( T38l > 
and Corollary [3] we have 



for SCA. 



;es 



(42) 



» 



ies 



Here we choose unitary matrix Q so that Q 1 (E X 1 A 
^jVA( rA ))Q becomes the following diagonal matrix: 



n , 



n 1 
2 log 



n 



ies 



L An) 



IL 



es 



nti£ 



a, 

Q- 1 (s^+S^ (rA) )Q = 

.0 a, 
From the second inequality of d42l . we have 

& > ar 1 =ar 1 (r A ), * = 1,2, 



(43) 



(44) 
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which together with the first inequality of (l42l yields that Then, we have 



= tr 



E X A + S JV A (r A ) 



On the other hand, by the first inequality of (|42| |, d44l i. and 
Lemma 21 we have 

L 

n&<0(D,r A ), (46) 

which together with the third inequality of d42l i yields that 

E Ri > ls(°(D, r A ), r s \r S o) for S C A . (47) 



(ED and @7) imply that ft L (Z>) C 7^ outJ (£>). ■ 
Proof of R sllm . L (D) > R® m>L {D): Assume that (iii.ife, 

■ • • , Rl) € TZl(D). Then, for any (5 > and any n with 

n > n (S), there exists (ipx, tp 2 , ■ ■ ■ , v?l, -0) G {R\ , R2 

■ ■ ■ , Rl) such that 

L 

Y,n\x l -x l \\ 2 <d+s. 



Q 1 ( S X A + S Arl(r<"))) Q 





J_ 






A 



1 





1 - c 



1 

1 







02 



A 



We set Za = X A Q, Z T i< A \ = Z\Q. Furthermore, set 



1 l - j 



By the rotation invariance of the squared norm and d48i >. we 
have 



For each I = 0, 1, • • • ,L-1, we use (tp r i u W(2), ¥V(l)) 
for the encoding of (Yi, Y2, ■ • ■ , Y£)- For i £ A and for 
I = 0, 1, • • • ,L - 1, set 

Wl,i = tp r '(i)( Y i), = lp T i {t) ((p T i {t) (Yi)), 

r^^UiY.-W^X,). 
In particular, 



_(n) _ r (n) _ 

'0,i — 'i ~~ 

Furthermore, set 

» ^ rJ») J") 



Wi|Xi), forieA. 



r ! (A) — l r i,i ' r ;,2 > j r i,L ) , ior { — U, 1, • ■ - 1 

L 



r (") ^ 



A 1 



E 



» 



By the cyclic shift invariant property of the source X L and 
its noisy observation Y L = X L + N L , we have 

L 

E E H x i ~Xi,i\\ 2 <D + 5 for 0<i<Z- 1,(48) 



1=1 

L-l 



L-l 



1 J«) _ 1 _(«) _ 1 _ (n) 



i=0 Z=0 

for 1 < i < L . 



i=i 



(49) 



We choose L x L unitary matrix Q = [qij] so that 



Q-^- x \Q = 



j_ 

Ai 







A 2 







(50) 



L L -. L-l -. 

Er^EiE^ii^-z 

t=l Z=0 



i=l 



L-l L 



^EE-EII^-^!! 2 ^^^ (51) 



_L ' — ' l — ' n 

i=0 i=l 



On the other hand, for i G A, we have the following chain of 
inequalities: 



log 



00 



log 



1 



L-l 



M-EC 



00 



1=0 



1 ^ n 



L ^— ' 2 

z=o 

L-l 



(b) 1 



L-l 



> 7E ( 2 ™)C ^ iE^I^M) (52) 



1=0 



> ^E /l ( Z ' i l Z A-W^(A)) 



/=() 

^ 7 E 2 log 1 (2 ^ e) 

i=o I 

(d) 1 ^ n 1 
= z ^-log<|(2 7 

i=o 



S X A + S Ar A (^™') 



1 L 1 -2r. 1 

1 X ^ 9 1 — e 

3=1 



( c ) ri 

> - log <( (27re) 



1 1 



L-l L 



EE^ 



1 2 . 

z=o j=l 



1 -2rJ . 
1 — C ; J 



-1 ^ 



(53) 



Step (a) follows from the concavity of log t. Step (b) follows 
from Lemma [5] Step (c) follows from Lemma [6] Step (d) 
follows from ( f50b . Step (e) follows from the convexity of 
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log t. From ((53), we have 

L-l 1 

Xi ' L 



g«> > 



1 1 \ -> X ~> 9 1 — C 

-EE4- — -2 — 

1=0 j=l 



(a) 

> 



1 L 1 -2-3-V I '- 1 r, ( " ) 

1 v , 1 — e L ^i=o i.j 



i=i 
1 1 - c 

a7 + - 



-2r<™> 



^(r^), forieA. 



(54) 



Step (a) follows from the concavity of 1 — e 2 *. On the other 
hand, by dBTl i and (1541 . we have 

L L 

0(r(")) = ^/3- 1 (r("))<^e1" ) <^ + ^- (55) 

i=l i=l 

Now we proceed to an evaluation of lower bound of the sum 
rate. In a manner quite similar to the derivation of ( |36] l in the 
proof of K L (D) C TZ^ ut) (D), we have 

^n(i? r i (i) +5) 
> 7(X A ; W r!(A) ) + nj^rf? for < i < L — 1. (56) 

iGA 

From ( TSoT ). we have 

1 L_1 

(=0 ieA 
L-l 



i£A 



1=0 



We estimate a lower bound of the first quantity in the right 
members of (IBTt . On this quantity we have the following chain 
of inequalities: 



L-l 



i^/(X A ;W Ti(A) ) 

1=0 

1 

= h(X A ) - - h(X A \W Tl(A) ) 

1=0 
L-l 

= h(x A )--J2HZA\w T , {A) ) 

1=0 

L-l L 

= h(X A ) - - E KZi^Wri^)) 



1=0 1=1 
L L-l 

> /iLx^-X^E^I-^m) 

i=l (=0 

> I log [(2.3)^1^1] -£|log [( 2 ^" 

1=1 



(n) 



n . n 
= — log | | - - log 



in) 



(58) 



Step (a) follows from (l52l l. Combining ( TSTl i and (l58"T l, we 
obtain 



E(^+*)^^fn^ B) . r(B) ) 

ieA \i=l / 



(59) 



Set 



l 

r = limsupr (n) = limsup - ^ -I{Yi\ Wi\Xi) 

i—l 
1 L_1 1 

£ = limsup£ n) = limsup- J] -E\\Z l - Z M [| 

n — >oo n — >oo -L/ 72 

By letting n — > oo in (l54l i. (l55l l. and d59l ). we obtain 

& > A" 1 ( r ) for i e A , 

L L 



iSA \i=l / 



> (60) 



(61) 



Since 8 can be made arbitrary small, we have 

6 >/?rV) for iGA, 

L L 

^hE^'m^E^^ 

i=l i=l 
iSA \i=l / 

From the first and second inequality of d6Tb and Lemma [4] 
we have 

L 

2=1 

Hence, we have 

Ri > 1{0{D, r), r) and <j>(r) < D , 



iGA 



which imply that R sm ^ L (D) > ^L.lP)' ■ 

B. Derivation of the Inner Bound 

In this subsection we prove IZ^ (D) C TZl(D) stated in 
Theorem [3] 

Proof of K { i n) {D) C ft L (L>): Since H^\d) C ^(D) 
is proved by Theorem Q] it suffices to show lZ L ln \D) C 
7e L in) (L») to prove K L in) (D) C ^ L (L>). We assume that 
i? L € (£>). Then, there exists nonnegative vector r L such 
that 



tr 



■>-i 



< D 



(62) 



and 



X i?i > A'(r s |r S c ) for any 5 C A . (63) 



Let Vi,i G A be Z, independent Gaussian random variables 
with mean and variance a v .. Define Gaussian random 
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variables Ui,i 6 A by f/j 
it is obvious that 

U L -> Y L -> X L 
C/s -> *s -» X L 
for any SC A. 



X t + iVj + V£. By definition 



(64) 



For given r, > 0, i G A and D > 0, choose er 2 /. so that 
<7y. = a%./(e 2ri — 1) when r, > 0. When n = 0, we choose 
Ui so that Ui take the constant value zero. Then, the covariance 
matrix of N L + V L becomes Y, N L( r Ly Choose covariance 
matrix Hp so that 

tr[E D ] =D, Z D h + E^)) -1 . 

Since (l62l l. the above choice of E^ is possible. Define the 
linear function ijj of J7 L by 

t(u L )=u L z-\ {rL) (z-\ 



y-1 



Set X L = $ (U L ) and 



da — E\\Xi 
d^j = E I X,; 



XII 2 
- X t ) ( X, 



X, 



1 < i ± 3 < L. 



Let S 



x L -x L 



be a covariance matrix with d\j in its 



element. Then, by simple computations we can show that 



J x L -x L 



-l 
x L 



N 



r 1 ^ 



D 



and that for any SC A, 

Mrs\rs°) = I(Y s ;U s \U S c) . 
From d62l l and d65l l, we have 

|X L -^([/ i )|| 2 = ||X i -X i || 2 



(65) 



(66) 



tr 



E" 1 ,. + E7 1 



<tr[Eij]=D. (67) 



J X L T N L (r L ) 

From ([64} and (|67), we have J7 L £ £(£>). Then, from 
completing the proof. 



VI. Proofs of the Results on Matching Conditions 

In this section we prove Lemmas Q][3] and Theorems [4] and 
[6] stated in Section III. 

A. Proof of Lemma [JJ 

In this subsection we prove Lemma [T] We first present a 
preliminary observation on 7?.^° ut ' ) (£>). For r L G Bl(D), we 
examine a form of the region 

1l { ™ t) {D,r L ) = {R L : £ ifc > J s (0(D, r L ), r s \r s ^) 

for any S C A . } . 

Let (A,/), / = {/s(rg|rso)}scA be a co-polymatroid defined 
in Property 12 Using (A,/), IZ^^ {D, r L ) is expressed as 

< out) (Ar L ) = {i^ : > /5(r S |r S c) 

for any 5 C A . } . 



The set TZ^ ut ^ (D, r L ) forms a kind of polytope which is called 
a co-polymatroidal polytope in the terminology of matroid 
theory. It is well known as a property of this kind of polytope 
that the polytope TZ^ ut \D^r L ) consists of L\ end-points 
whose components are given by 

= f{7T(i),---,7r(L)}(r{ 7 r(i),---,7r(L)}\r{ 7T (l),...^(i-l)}) 

-f{7T(i+l),---,T,(L)}(r{Tr(i+l),---,TT(L)}\r{ 7T (l),---,Tr(i)}) )■ (68) 

for i = 1,2, 1 , 

Rir(L) = /{7r(i)}('"7r(L)k{ 7 r(l),..., w (i-l)}) , 

where it is an arbitrary permutation on A, that is 

1 2 ••• i •■■ L 

tt(1) tt(2) • • ■ 7r(i) • • ■ tt(L) 

For £ = 1, 2, • • • , L, set 

B*,l(D) = {r L : r L G B L (£>) and 

r w (j) = for i = l + l, ■■ -,L}, 

dB^j(D) = {r L : r L G dB L {D) and 

r -K(i) = for i = I + 1, ■ • • , L} . 

In particular, when ir is the identity map, we omit it to write 
Bi(D) and dBi(D). By Property [T] when r L € the 
end-point given by d68l becomes 

= /{ 7 r(i),---, 1 r(i)}(''{7r(i),---^(0}l r {f(l),---^('-l)}) 

-/{7 r (i+l).---,7r(i)}( r { 7 r( t +l),---,7 r (0}l r { 7 r(l),---,7r( l )}) 

for i = 1,2, 1, 

^ji-(J) = /{7r(i)}( r 7r(Z)l r {7r(l),---,7r(i-l)}) , 

-RTr(i) = 0, for i = I + 1, • • • , L . 

'(69) 

Proof of Lemma\J] Fix r L <E Bl(D) arbitrary. Let R L be a 
nonnegative rate vector such that L components of R L satisfy 
(|68| >. To prove LemmaQ] it suffices to show that this nonnega- 
tive vector belongs to (D). For I = 1, 2, • • • , L, we prove 
the claim that under the MD condition, if r L G B T i(D), then, 
the rate vector R L satisfying (l69l belongs to TS.^* (-D). We 
prove this claim by induction with respect to I. When 1 = 1, 
from (|69l , we have 



-Rtt(I) - /{tt(1)}(^(1)) ■ 



R 



7r(t) 



0, for i = 2, • • • , L . 



(70) 



The function /{7r(i)}( r 7r(i)) is computed as 

/Mi)}(Mi)) 

= iZ{7r(l)} ^(^i ? ' i )^ 7 r(l) kW!)}°) | r 



{t(1)} c 



= - loe + 
2 B 



"x 1 



^P,^)|r wi)} o=0 



Since r L € Bn,i{D), we can decrease 
B-rr.i(D) so that it arrives at 
satisfying 



«(i)» r {T(i)}°) = ( r ^(i)' ' 



(71) 

keeping r L G 
= or a positive 

0) G9B w ,i(£>). (72) 



L-l 
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Let (-R*^), be a rate vector corresponding to 

K(iy r M Q}')- If ^; ( i) = 0, we have r L = e B L (I>). 
Then, we have 



tr 



y-L 



tr [E 



This contradicts the first assumption of D < trpx^]- 
Therefore, r*^) must be positive. Then, from (|72l i, we have 

, ■ • ■ , r; (l) ) = , o 1 _^ 1I o) e (d) . 

L-l 

By ( T7TT > and the MD condition, /{,r(i)}(^7r(i)) is a monotone 
increasing function of Then, we have R^fi) > ^-(lV 

Hence, we have 

{R v{ i),---,K{L)) = (i^ ( i),0,---,0) Gft£ n) (£>). 

L-l 

Thus, the claim holds for / = 1. We assume that the claim 



holds for l — l. Since tr 



T V'(r')) 1 



is a monotone 



increasing function of r^m on B Wt i(D), we can decrease r 



t(0 

keeping r L G Bn.i(D) so that it arrives at r*^ = or a 
positive r* /-j-j satisfying 

(r; (0 ,r {w(0} c)e9S^(Z>). (73) 

Let (-R^n), • ' ' i -R^(l)) be a rate vector corresponding to 
( r 7r(z)' r {7r(0} c )' Property [2] part b) and the MD condition, 
the / functions 

/{7r(i),---,ir(i)}(' , {7r(i),---,T(i)}l r {T(l),---^('-l)}) 
-/{7 r ( J + l),---, 7 r(i)}( r {^(i+l)r--^(0}l r {^(l),---^(i)}) 

for i = 1,2, 1, 

/{7r(i)}( r 7r(0l r {7r(l),---^(i-l)}) 



appearing in the right members of (|69| i are monotone increas- 
ing functions of r v ny Then, from (|69l l, we have 



^7 



®>K(i) fori = l,2,---,«, 



^Tr(i) — -rV(i) 



for i = 1+ i. 



(74) 



When r* { p = 0, we have (r* {l) , r {n(l)r ) G B^,i-i(D) . Then, 
by induction hypothesis we have 

{Rl {1) ,--- 1 K (L) )ent\D). 

When r*/« > 0, from d73l . we have 

« (1) ,---,K (i) )e^( J D). 



Hence, by (|74[). we have 

(-Rtt(I), ' • ' ,R-k(L)) 

= (i^d), • • • ,^,0, • • • ,0) e ^(D) . 

L-( 

Thus, the claim is proved. 



B. Proofs of Lemmas \2\and\3\ and Theorems^\and\6\ 

In this subsection we prove Lemmas [2] and [3] and Theorems 
g]and|6] 

We first observe that using the eigen values atk = a.k(u L ), 



k G A of £ 



-1 , y.-l 

ti- 



the condition 



N L (u L ) 



< D 



is rewritten as 



1 

§ a t {u L ) - D ' 



(75) 



Next, we present a lemma necessary to prove Lemma [2] 

Lemma 7: For the eigen values a k = afc(it i ),fc G A of 
£~^i + ^nl( u l) and for G A, we have the followings: 



dak 

du.i 



> 0, for k G A, ^ 



fc=i 



Proof of this lemma needs some analytical arguments on the 
eigen values of positive semidefinite Hermitian matrix. Detail 
of the proof will be given in Appendix C. 

Proof of Lemma [2} Let 5 be a set of integers that satisfies 
a" 1 > £ in the definition of 9(D,u L ). Then, 6(D,u L ) is 
computed as 



6(D,u L ) 



\kes 



L-\S\ 



kes 



Fix i G A arbitrary. For simplicity of notation we set A, 

(an + c.i) and set 

* = Iog T ^--logfl(A« i ). 
Computing the partial derivative of by Ui, we obtain 



A 



dui ^t\dui J 



kes 



1 



At - m 



From Lemma [7] and d76l i, we obtain 



(76) 



fees 



dui fri V 5m 



1 



1 L H 

"fc L> - — a l At - a E 
fees 



To examine signs of contents of the above summation we set 

1 L-\SC 



— > rvi. 



fcGS 
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If |5| = L, $fc > 0,/c G A is obvious. We hereafter assume 
\S\ < L — 1. Computing we obtain 



* fe = A i \D-Y j — 



1 



Q-k 



(Ai - a m in) 



+ (a k - a 



> 



l\ L-|5| 



(Aj - Q n 



( a ) . ^ 1 X-|S| 



>^ E - 



ha- 

(-^■i ^min) 



L-|gj ^~l-g| / 4 v 
> Ai ■ • (Ai - a m in) 

"max "mill 

= ML-\s\)(-± — + \ 

Step (a) follows from the inequality (l75k that is, 

^ Mr L ) 

From ( l77l ). we can see that if 

1 1 1 

< — for i G A, 



a m in(f ,i ) a max (r L ) A 

then, $ fc > for k G 5 . 

Proof of Theorem |?} By d75l l. we have 

1 L — 1 

< D - 



amin(r L ) 



a m ax(r- L ) 

1 D L 



Hence, if 



a max (V L ) a max (r L ) 



L 1 

D — r- < 



or equivalent to 



L> - 



a m ax(7 L ) < L 



a ma x(r L ) < a max for r L e B L (D). 
It can be seen from (F78b and ( F79b that 
1 



Proof of Lemma \3] Let 5 be a set of integers that satisfies 
P' 1 > £ in the definition of 9(D,r). Then <?(£>, r) is 
computed as 

Fix i G A arbitrary and set 

* = 2Lr- log 0(.D,r)- 
Computing the derivative of "J by r, we obtain 



(77) 



d* 2 

d?' a 2 e 2r ^-^ 
kes 



E 



^"^ei^ 

kes 



2L 



L 



1 1 | j2c 2, 



fees 



To examine signs of contents of the above summation we set 



1 

/3 fe /3 fc 



^*(--gs) 



If |5| = L, $fe > 0, k G A is obvious. We hereafter assume 
|5| < L — 1, Computing <J>£, we obtain 



W v 1 L-jgj , 2r L v 1 



keA-S 



Pk Pk 



> 



L \S\ L \S\ +a 2 e 2r- {L _ lsl) 



Mm ax 

(L-\S\) 



Ptain 

l l 



W\ 



Pn 



Pn 



2„2 

er e 



r L_ P 

\S\ ' Pn 



max 
min 



(78) 



holds for r L G Bl(D) and i 6 A, the condition on a m in and 
ciWx m Lemma |2] holds. By Lemma [7] we have 



_ /3max /^m 

Step (a) follows from 

^-E^>o^-E^ E w 



(82) 



fe=i 



(79) 



From d82l , we can see that if 
1 1 



a max < L for i G A . (80) 



/^min /^max | ^ | /^r 

then, $ fe > for k G 5 . Since \S\<L — 1 



(83) 



is a sufficient condition for d78l l to hold. By Lemma [7] we 
have 

(Hi + Ci < "max for * e A. (81) 
From (fSOt and ( TSTb . we have 
1 



1 



1 



< cr^e 



lr L /?min(^) 



D 



^max — ^max 



Thus, if we have Z?a max — 1 < L or equivalent to D < 
(L + l)/a max , we have ©. ■ 



/9min(r) /3ma X (f) L — 1 Anax(f) 

is a sufficient condition for d83l to hold. 

Proof of Theorem |6} Computing /? mm — /?m a x' we nave 
1 1 

/3min(r) /3max(r-) 

\nax -^rnin 
= {1+ A_ (1 _ e _ 2r) }| 1+ A_ (1 _ e - 2r)} 
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On the other hand 



Set 



,2r 



AnaxO") ~ 6 l + ^ r (l_ c -2r) ' ^ 
. Am i n 



«i = — — r = {a + b + c(l - c- 2 ^)}" 1 



Then, we have 



Hence, if 



A, 



or equivalent to 



we have 



a* > 



1 



L-l K 



L A m i n 

1 



L-l An 



(Amax Amin) 



u l = v i 1 - 6 , 

?'( = - log =- 



(87) 



/3min(r) /3 max (r) 
for r > 0, completing the proof. 



< cr 2 e 2r ^ ^ min ( r ) 



From ( TT4b in Section IV and d87l ). we can see that the condition 
r L G Bl(D) is equivalent to 

L 

6 ViVj - (1 + £>&) ^ Vi + D > 
«=1 



L-l /3 max (r) 



VII. Conclusion 

We have considered the distributed source coding of corre- 
lated Gaussian observation and given a partial solution to this 
problem by deriving explicit outer bound of the rate distortion 
region. Furthermore, we established a sufficient condition 
under which this outer bound is tight. 

In this paper our arguments have been concentrated on 
Problem 2, the determination problem of TZl(D). On Problem 
1, the determination problem of 1Zl(D l ), the techniques 
we have used to derive the outer bound of TZl(D) are not 
sufficient to derive an outer bound of 1Zl(D l ). 

In l20l . we introduced a unified approach to deal with 
Problems 1 and 2 and derived outer bounds of the rate 
distortion regions on those two problems. For Problem 1, 
the outer bound of [20 ] has a form of positive semi definite 
programming. For Problem 2, the outer bound of 1201 is the 
same as that of this paper. Recently, we have obtained some 
extentions of the results of Oohama ||20l . Details of those 
results are to be presented in a future paper. 



Appendix 

A. Proof of Theorem [S] 

In this appendix we prove Theorem [8] 
Proof of Theorem [§} We first observe that 



\i=l ) i=l 

L 

-(1 + Db)Y^Vi + D > 

i=i 

From (f86l > and d87l i. we have 
L 1 



(88) 



y-1 . y-1 



1 = 1 

L 



(a + b + c)vj — 1 



to l 
> -log 



c 

(« + Hc)iEti" t -i 

+ilogfl-65^«iJ . 



(89) 



L 1 

E r i + 2 l0g 

i=i 

L 1 



y-1 | y-1 
^ X L I" V(r l ) 



Step (a) follows from the convexity of — log i. Here, we set 
7={tX>) ■ 



Then, from d89l , we have 

L 

^ '* ' + 2 



1 

£ r ' + 9 l0 S 



i=l 



(Dc) 7 



> -1 

- 2 ° g D(a + b + c) - 7 ' 2 



L 



-log (!-(£>&)- ) .(90) 



|s x ,| = (i- /9 ) i a + 



N L (r L ) 



2—1 / Z— 1 



____ 
1-P 



1(^ + 6) 



-log|S^|,(84) 



(85) 



Since 



and 



we obtain 



(86) 



bL(L - 1) 7 ~ 2 - (1 + Db)L"j- x + D >0 
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Since Vi < b 1 for i G A, 7 must be 7 > Lb. Solving < f9T~b 
under this constraint, we obtain 



L 



l + Db+ J(l-Db) 



ADb 
L 



Ll 



(92) 



Combining (84}, (gUl, ([90]>, and (92}, we have 



E^ 



2 l0g 



J N L (r L ) 



iTr 1 I 

l 2 ^ I 



(1 - p)£ic 



> - log . 



Li 



1 jljJL-lW LD6 

2 H 1-P V i 



?)} 



The equality holds 

n = 2 bg ^(a + 6 + c) - Li 
completing the proof. 



, for i e A 



where 



3m ,- =1 ct JV 



4 



3 = 1 JV J 



(94) 



vy, j S 5 — {i} are suitable constants and 7Vi is a zero mean 

Gaussian random variables with variance — . For each i £ S, 

gu 

Ni is independent of Zj,j G S — {i} and Y,-, j G 5. 

Proof: Without loss of generality we may assume i = 1. 
Let £x s Ys De a covariance matrix on the pair of the Gaussian 
random vectors Xg and Yg. Since Yg = + Ng, we have 

Since Zg = XgQg, we have 

Qs ^x s Qs Qs ls ^s 

The density function pz s Y s ( z S,ys) of Yg) is given by 



Pz s Y s (zs,ys) = rc 

(2^e) s |S ZsYs p 

where Ys has the following form: 



zs 

£ 



Set 



= [Qs'^xI+^nDQs] 

S 

= [QS 1 Z x 1 s Qs] ii +Y, 



u 

qkiqkj 

k=l 



a 



(95) 



Now, we consider the following partition of T, z Y : 



Qs 1 (^- , x 1 s 






-S 


N S Q S 


9n 


512 




_ h 9i2 


G22 





y-1 



where gu, gi2, and G22 are scalar, 2s — 1 dimensional vector, 
and (2s — 1) x (2s — 1) matrix, respectively. It is obvious from 
the above partition of that we have 



91 



i = »n = [Qs 1 XxlQs] n +J24 L 



B. Proof of Lemma [6] 

In this appendix we prove Lemma [6] Without loss of 
generality we may assume that S — {1, 2, • • • , s}. We write 
unitary matrix Qg as Qg = [qij], where qij stands for the 
element of Qg. The unitary matrix Qg transforms Xg 
into Zg= XgQg. The following lemma states an important 
property on the distribution of Gaussian random vector Zg. 
This lemma is a basis of the proof of Lemma [6] 

Lemma 8: For any i G S, we have the following. 

Z ' = ~E^ + zE|- y i + ^ (93) Set 



fc=i 



(96) 



912 = [V\2 ■ ■ ■ VlsPllPu ■ • • Pis] ■ 

It is well known that Yr^ sYs has the following expression: 



^ZsYs 



9u 


912 


l 9i2 


G22 



1 


012 " 




' 9n 


0l2 


— 9u 






'012 


G22 


- ^7^12512 



312, 



912 



A 



y -i\ z s-{i\ys\ 



Il-i 
1 



911 



012 



(97) 



Then, we have 

[zsVsX^ZsYs 

= [zi\z s _ {1} yg] 
= [hl\zg^ {1} yg] 



= zi-\ 




'W 




t ys_ 




911 


912 


_ l gi2 


G22 _ 


' 911 




'012 


G22 



"-1 



Z S ~{1} 



0i 



n 

911 



512512 



Z S-{1} 



•(98) 



From (|95]>-(|97]>, we have 

n x = z x + — ^ i/y^- + — E 



9ii 



J=2 



.911 



3=1 



1 \ - 1 \ ^ qji 

z i + — l^ v i3 z 3 - — 2^ -srVj 



(99) 



y^ 1 



Q s 1 (s x 1 s + s^)g s 



?5 ^Af s 



It can be seen from d98l ) and ( |99l that the random variable N\ 
defined by 

311^ aufri^ 
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1 



\h(9 1 \Z s _ li} ,W s ) 



is a zero mean Gaussian random variable with variance From ( 11021 ), we have 

and is independent of Zg_.ru and Yg. This completes the 
proof of Lemma [8] ■ 
The followings are two variants of the entropy power 
inequality. 

Lemma 9: Let Ui,i = 1,2,3 be n dimensional random 
vectors with densities and let T be a random variable taking 
values in a finite set. We assume that Us is independent of 
Ui, L/_, and T. Then, we have 



1 



2ire 2ite 2ire 

Substituting (1103b into (tlOlt . we obtain 

„2fcW p 2fe("' 11, 1 
_ > _ _ e $K*i\x s ,w s ) + J_ _ 

27re — 27re 27re <j_ 



1 

27TC 



c |h(t/ 2 +[73|C/ 1 T) > J_ £ h(U 2 \U 1 T) , J_ c ^ft(C/3' 

27TC 



27TC 



Lemma 10: Let ?7i, z = 1, 2, 3 be n random vectors with 
densities. Let Ti,T 2 be random variables taking values in 
finite sets. We assume that those five random variables form 
a Markov chain (_i,Z7i) -> C/ 3 -> (T 2 ,L7_) in this order. 
Then, we have 

1 P %h(Ui+U 2 \U 3 TiT 2 ) 
2ttg c 



> 1 e ^h(Ui\U 3 Tj 
— 2ttc 



1 % h(U 2 \U 3 T 2 
2nc 



Proof of Lemma [6} By Lemma [8] we have 
Zi = -—y^UjjZj 



y -i i t u n ■ 
3=1 jv j 



where iV, is a vector of n independent copies of zero mean 

Gaussian random variables with variance — . For each i £ S, 

gu 

Ni is independent of Zj,j <E S — {i} and Yj,j G S. Set 

^)^Ifc(Zi|Z s _ {i} ,Ws). 
n 1 ' 

Furthermore, for k € A, define 



5 fe = {fc, fc + 1, • • • , S } , * fc = * fe (F s J £ £ W-Yi 



i=fc 



Applying Lemma [9] to ( 1 1001 ), we have 



1 2/i ( " 



2?re 



> 



1 1 



^ ;fc(*l|Z S - {i} ,Ws) + J__ (101) 

(5ii)^27re 

On the quantity /i(^i|z5_{i}, Wg) in the right member of 
(11011 ). we have the following chain of equalities: 

fc(*i|Z__ {i} ,W_) 
= I(^ i; X s \Z s _ {l} ,Ws) + 11(^^X3, Z s _ {l} ,W s ) 

^ _(tf x | Zg\Zg_ m ,Ws) + h(*i\X S , W S ) 

= J(*i; Z. t |Z s _ w , W_) + M*i|^5, W_) 
= ^(ZilZs.^, W S ) - Z s _ {1} , W_) 

+M*i|-X"sr,W S ) 
( = } n/iW -/i(Z 4 |* 1 ,Z s _ w ) + ^(* 1 |Xs,M/ s ) 
= n/l («) _ I bg ^Tre^r 1 ] + 1 |J_ _ , Vy s ) • (102) 

Step (a) follows from that Zg can be obtained from Xg by 
the invertible matrix Q. Step (b) follows from the Markov 
chain 

z, z s _ {i} )-y s -»w s . 



Solving ( 1104b with respect to 



we obtain 



2?re 



> 



9ii -75—° 



/l(*l|X S ,W S ) 



(103) 



(104) 



(105) 



Next, we evaluate a lower bound of e«' 1 '* 1 ' Xs,w/s - ) . Note that 
for j = 1, 2, • • • , s — 1 we have the following Markov chain: 



(W_ J+I ,* i+ i(F_, +1 )) ->X S 



(106) 



Based on < fl06l we apply Lemma [TO] to ^-en h ^j\^s,w s ) 
for j = 1, 2, • • • , s — 1. Then, for j = 1, 2, • • • , s — 1, we have 
the following chains of inequalities : 

1 



2ttc 



1 „M Sj+i+^-Vj 



2?re 



> J_ e l h K+ii x s,^ +I ) + 



7T~ 1 j 



2ne 
27re 



2ttc 



X s ,Wj 



(107) 



Using ( 1107b iteratively for j = 1, 2, ■ • ■ , s — 1, we have 



1 s 

___ e £M*i|X s ,W s ) > 
9-ttp — ^ 



-2r v 

2 e ^ 

9 ji -2 



2ne J " fTp 

Combining (O, ( I105b . and (1108b . we have 



(108) 



2?re 



> 



l-e" 



'A', 



(109) 



completing the proof. 



C. Kgen Values ofT, x i + Y, N \ (uL) 

In this appendix we prove some properties on eigen values 
of L ,. Using those properties, we prove Lemma 

m 

We first consider the case treated in section IV, where £ x i 
+£~ vZ < L ^ has the identical value b of non diagonal elements. 



Using (lT2l) . we can show that 014,1 = 1,2, ■■■,L are L 
solutions to the following eigen value equation: 

ft , \ L 



2—1 / Z— 1 



J( Ui + 6-a) =0. 



(110) 



18 



8(a) 





a=u h +b a=u h +b ■■■ a=u im frb a=u,+b 



Fig. 1. Shape of g(a). 



Let m be the number of distinct values of Ui,U2,- ■ and let 
Ui 1 < Ui 2 < ■ ■ ■ < Ui m be the ordered list of those values. For 
each j = 1, 2, • ■ • , m, set Cj — {I : u\ = u i;j } and lj — \Cj\. 



Then, the eigen value equation (II 10b becomes 



Uj +6 — OL , 

J=l J / J=l 



+ =0. (Ill) 



From d 1 1 D , we obtain the following proposition 

-(it 1 -) 



Proposition 1: Eigen values of Y, xL -\-Y, NL , L , satisfies the 



following two properties, 
a) The matrix + L s has m positive eigen values, 

which are the m distinct solutions of the nonlinear scalar 



equation 



! = .<?(«)=£ 



. ui. + b - a 

3=1 3 



(112) 



Let oi\ < OL2 < ■ ■ ■ < a m be the ordered list of solutions 
of d 1 1 2b . Then, we have 

< ol\ < Ujj + b < ct2 < Ui 2 + b < ■ ■ ■ 

<a m <u im +b. (113) 

The multiplicity of those eigen values is 1. 
b) When lj > 2, the matrix E^i +^'jv I '(« 1 ') ^ as tne e ig en 

value Ui +b with the multiplicity lj — 1. 
Proof: We first prove the part a). From ( 111 II ). we can see 
that every solution of the equation 1 = g{a) is an eigen value 
of S~i+S^i (ui) . Since 



/(«) = E 



J (ui, + b - af 



>0, 



<7(a) is differentiable and monotone increasing in each of the 
m open intervals (— oo, u^+b), (u^+b, Ui 2 +b), ■ ■ ■, (ui m _ 1 + 
b, Ui m +b). Since g(a) is unbounded in each of these intervals, 
it has positive and negative values there, and thus 1 = g(a) 
has a unique solution in each of these m disjoint intervals. In 
particular, since 

L 

E~\ + S"i (ui) = (1 - .g(0)) Y[( Ui + b)>0, 



we have < g(0) < 1, This implies that 1 = g(a) has a 
unique solution in the interval (0, +b). Furthermore, since 



lim g (a) 

alui m +b ' 



lim g (a) 

a— »+oo 



o. 



there is no eigen value in the open interval (uj TO + b, +oo). 
Summarizing the above arguments, we obtain (|1 13|) . For 
convenience we show the shape of g(a) in Fig. Q] The part b) 
is obvious from d 1 1 lb - ■ 
Next, we consider the case where X L is a general covari- 
ance matrix. Set 



u x L 



-i-i 

J N L (u L ) 



Ul 


b\2 


%2 


B22 



Let rji, r)2, ■ ■ ; f)L-i be L — 1 eigen values of £?22- Since -B22 
is positive definite, those L — 1 eigen values are positive. Let 
p be the number of distinct eigen values of B22 and let rj^ < 
r]k 2 < ■ ■ ■ < rjk p be the ordered list of eigen values of £?22- For 

each j = 1,2, •■ • ,p, set Tj = {I : m = ?] kj } and tj = \Tj\. 
For each j = 1,2, • • • ,p, the quantity tj is the multiplicity 
of the eigen value g k ■ Choose the (L— 1) X (L— 1) unitary 
matrix Q22 so that 



fc Q22-S22<522 — (?22 L ^22Q 







m 







T}L-l 



and set 



A 



^12 = [b\b 2 ■ ■ ■ b L -i) = &12Q22 • 



Then, we have the following lemma. 

Lemma 11: 



J x L 



air 



L-l 

(ui - a) n - a ) - 




L-l 

E 

L-l 



Vj\{{m-a) 



1=1 



Proof: Set 



Then, we have 



A 


1 


O12 " 




[*0l 2 


022 



-1 



^N L (u L ) 
i-l 



- ol!l)Q 
olIl)Q 



1 


0l2 " 




Ui — a 


bi2 


'012 


^22. 




%2 


B22 — oiIl-i 



1 


012" 


>12 


Q22. 



ui — a 


&12Q22 


t Q22 t bl2 




^22(^22 — o;Il-i)Q22 



Ui — a 


bu 




rji — a 




r/2 - a 


%2 




?/L-i - a _ 
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By (11141 ). we have 



J N L (u L ) 



aI L )Q 



U\ — a 


bi2 




m - a 





%2 


m 


— a 







VL-i - a 



L-l 



L-l 



(ui - a) JJ (77/ - ") - 51 ^ Il^-j ~ 



z=i 

L-l 



«i — a 



E 

2=1 



3 



L-l 



-qi-a 



i=i 



completing the proof. ■ 
From Lemma [TT] we obtain the following proposition. The 
first two parts in this proposition are known results (cf. ll2TlD . 



Proposition 2: Set ej = 2~2ieT- bf an d 



Ci = {j : 1 < j < V, ej > 0} . 



A 



C 2 = {3 : 1 < j < p, ej = 0} 



Then, eigen values of + ~E NL ^ uL ^ satisfies the following 
three properties. 

a) Set w = \C\\. Let j\ < 32 < ■ ■ ■ < j w be the ordered list 
of C\. For i = 1, 2, • • • , w, set kj ( — k{. Then, the matrix 
+ E~ffit u L\ has (w + 1) eigen values, which are the 
(w + 1) distinct solutions of the nonlinear scalar equation 



u\ = g{a) =u-^2 



= *-£ 



1 a - ^ 



(115) 



Let £0 be the set of solutions of ( II 15b and let ai < a 2 < 
• • • < a w+ i be its ordered list. Then, we have 

< ai < ^ < a 2 < % 2 < ■ • ■ 

< Q^; < 77^ < a w+ i , (116) 
ai < iti < a^+i . (117) 



b) Set 



£1 = : tj > 2, j e Cx] , £ 2 = { Vkj : j G C 2 } 



By the above definition and (jl 16[) . we have £0 H £ 1 = 
f 1 0^2 = ■ The set of all distinct eigen values of £ ~ L + 
S iV* («*<) is S iven b y ^oU fiU £ 2 . For each 77^. G £\, the 
multiplicity of 77/.. becomes tj — 1. For each 77/.. G £2 
n(fo) c > the multiplicity of 77^ remains tj. For each yyfe 
£ £2<~)£o, the multiplicity of 77^. becomes tj + 1. The 
multiplicity of a G £0 ri(£ 2 ) c is 1. 
c) Every eigen value of + £^i/ u z,\ is a monotone 
increasing function of u\. 



8(a) 






/■ 1 / 




Fig. 2. Shape of 3(a). 



Proof: By Lemma [TT] the eigen value equation of 



u\ — a 



u\ — a 



i-i 12 \ L-i 

V \ V 

77t. — a 



HiVk, -a)*> [=0(118) 
jec 2 



jeCi 

We first prove the part a). From dl 18t , we can see that every 
solution of the equation u\ = g(a) is an eigen value of 

S X i + S Af'-(u 1 ')' SillCe 

w 

g(a) is differentiable and monotone increasing in each of the 
(w + 1) open intervals (-00,^), (r?^,??^), • • •, (ry^.oo). 
Since g(a) is unbounded in each of these intervals, it has 
positive and negative values there, and thus u\ = g(a) has a 
unique solution in each of these (w + 1) disjoint intervals. In 
particular, since 

L-l 

s-i + s-i (u£) | = (m - 0(0)) n 77, > 0, 

we have < g(0) < iti. This implies that ui = has a 
unique solution in the interval (0, 17^ ). Hence, (|1 16^ is proved. 
It remains to prove (jTTVj) . Since m = g{ai) = g(a w +i), we 
have 

w , . 

> 0, 



Ml - CWi 



E 



( ^o. 



£1 ^fc, - a »+l 
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Steps (a) and (b) follow from p 16[) . For convenience, the 
shape of g(a) is shown in Fig. [2] Thus, the proof of the part 
a) is completed. The part b) is obvious from (11 18b . Finally, we 
show the part c). Taking the derivative of (II 15b with respect 
to Mi, we obtain 

i ~>t \ da 
au\ 

from which we obtain 




da 



1 



E 



> 0. 



Hence, every eigen value belonging to £q is monotone increas- 
ing function of u\. If the eigen value does not belong to £q, 
it does not depend on Mi. Thus, the part c) is proved. ■ 
Proof of Lemma^ It suffices to prove the claim of Lemma 
[7] for i = 1, that is, 



> 0, for k G A, 



C^max ^ Ml ^ Q^min j 

dak 

1 



E dak 
dux 
fc=i 



(119) 
(120) 

(121) 



Inequalities (11 19b and ( 11201 ) follow from Proposition [2] parts 
a) and c), respectively. It remains to prove (1121b . Since for 
any matrix its trace is equal to the sum of its eigen values, we 
have 

L L 
k=l k=l 

Taking partial derivative of both sides of (1122b with respect to 
Mi, we obtain (1121b . ■ 
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